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SECTION 1 



INTRODUCTION ' 

The general method or framework for instruction employed in most 
programed teaching units available for public school use is presumably 
derived from well established learning principles (49) . Given a • 
program which is constructed according to the relevant principles, 
it is expected that individuals with a relatively wide range of 
abilities will attain fairly similar achievement levels (31j 37) • 

This expectation derives from the principles used in constructing 
the program, the empirical tests of the program on appropriate samples 
of learners, and recognition of the possibility that Subsequent users 
of the program may proceed at their own rates of speed through the 
material. 

Although one might wish that the learning conditions provided 
by programed instructional materials would solve the problem of 
individual differences in education, it is difficult to find any 
support for this proposition. Recent reviews of the research litera- 
ture on programed learning (38, 48, 50) indicate that there has been 
little research on the effectiveness of programed materials for 
teaching learners with different characteristics. However, a few 
studies directed at this problem, suggest that this is an important 
direction for future research efforts in the field of programed 
instruction. 

Moore, Smith and Teevan (37) cite several studies which support 
the conclusion that programed materials accentuate, rather than reduce 
individual differences. That is, given a hete2X>gen60us group of 
individuals, the level of achievement attained at the end of a 
programed unit varies considerably from individual to individual. 

In their own research with college students, these authors found 
evidence indicating that achievement with programed instruction 
was in part a function of the level of difficulty of the program 
and the motivational characteristics of the S, 

Gotkin (19) reports that the single most common criticism 
students make after using programed materials for a time, is that 
programed materials are boring. An informal comparative study of 
two typos of English programs was attempted in order to determine 
students’* reactions to different types of program structure » The 
programs were English 26OO , a linear, constructed-response pro- 
gram which is an exemplar of the most widely used format in programed 
materials; and Markle's (36) Words program, a nontypical linear 
program which has a conversational style, emphasizes hypothesis 
making, and contains irrelevancies such as witticisms. Junior high 
school students of different ability levels who had experienced both 
programs were asked to comment on which program they preferred, 
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with reasons for their preferences. The results, presented in- 
formally, indicated that the high ability students overwhelmingly 
preferred Markle*s nontypical program, whereas the highly repeti- 
tive English 2600 was characterized by these students as boring . 

On the other hand, a large group of the low ability students pre- 
ferred the certainty and repetition of English 2600 and considered 
it to be more interesting than the Words program. 

In summarizing the present state of affairs with regard to 
meeting individual differences in programed instruction, Gotkin 
(19) concludes: 

....there is little evidence that programs thus far 
written for classroom use really individualize class- 
room instruction. To pass through a single instruc- 
tional path at one’s own rate cannot be equated with 
the tutorial situation. To argue otherwise is to 
offer a naive notion of individualized instruction. 

By enabling students to proceed on their own and at 
their own pace, programed instruction does break the 
traditional lockstep of classroom procedure. In 
breaking the lockstep it makes an enormous stride 
forward in individualizing instruction. But that is 
only one dimension of individualization (p. ll). 

Research on this problem may be approached in several ways, 
all of which may contribute varying amounts of information of both 
practical and theoretical significance. Assuming a theoretical 
orientation in all cases, the first and most simple approach might 
be to select one or more characteristics of learners and look at 
the relationships between these characteristics and achievement 
with a particular style of program. Another approach would be to 
select a given characteristic of the learner such as IQ level, 
and .look at the achievement levels of learners with different 
IQ levels under different program structures. An even more com- 
plex approach would be to simultaneously vary the structure of 
the program along a number of dimensions for learners classified 
on the basis of several personality dimensions. The problem may be 
further complicated by introducing other important variables such 
as different types of program content. 

The present authors decided to use the first and simpler model 
as an initial approach to this problem. It was also considered 
desirable to use an acceptable commercially-available program and 
to administer this program in a fashion closely resembling the 
normal usage of programs in the typical classroom. Using this 
approach it was reasoned that the results of the study might yield 
information which would be generalizable to a wider range of class- 
rooms. 
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Rationale for the Study 

Ah Analysis of the General Characteristics of Programed Material^ 

After examining a cross-section of programed materials;, the 
vriters identified th« following charaoteri ?tics which appeared to 
describe the style or structure of a wide range of programed 
materials. The account is purely descriptive. For convenience, 
thi3 descriptive account will be subsequently referred to as the 
structure of the programed learning task. 

Some Major Characteristics of the Programed Learning Task 

!• Restrictiveness : the learner is required to respond either 

by thinking the answer or writing it out. The response 
allowed by the program is very limited and the learner* s 
thinking is forced to conform severely to the require- 
ments of the program. 

2. Repetitiveness : the content of the lesson is arranged 

in a series of small steps which systematically repeat 
the essentials of the lesson, 

3. Support : the learner knows immediately when his response 

is correct (he is reinforced continuously for correct 
responses) . 

4. Regulation : the learner controls some aspects of the 

learning situation (e.g., he works at his own speed; he 
works privately). 

Organization : the content of the lesson is highly organ- 

ized in a logical sequence of related facts, concepts 
and rules designed to lead the learner to criterion be- 
havior. 

Difficulty Level : the program is constructed so as to 

yield a low error rate. The content and much of the 
structure of the individual frame is determined empirically 
to insure that the prog: -am communicates successfully with 
a high percentage of Ss in the typical classroom. 

7. Motivation : there is a relative absence of social, 

emotional and intellectual exchange between the learner, 
other students, and the teacher. The major source of 
motivation is presumably intrinsic to the learner and/or 
the program. 

This descriptive account of the programed learning task suggests 
that its structure greatly accentuates certain aspects of teacher 
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inodes of presentation of subject matter (e.g., organization, rei Dti- 
tion, etc.), ■while others are made less salient or are largely absent. 
However, unlike teachers in general, most programs available for 
use in the classroom are relatively more homogeneous from the point 
of view of the structure of the presentation of learning material. 

Relationship of the Structure of the Programed Learning Task to 
Characteristics of the Learner 



A review of the literature on personality led the investigators 
to focus on two personality characteristics which appeared to be 
related to learning via the structure of the programed learning 
task - creativity and anxiety. 

The first of these learner characteristics, creativity , is 
conceptualized on the one hand as a type of thinking ability (22), 
and on the other hand as a personality disposition (l, 2, 33). As 
an ability, creative or divergent thinking is contras'bed with other 
mental abilities such as IQ test performance (l7, 4l). For example, 
Guilford (22) has compared divergent or creative thinking with con- 
vergent thinking. He differentiates between the two as follows: 

In tests of convergent thinking there is almost always 
one conclusion or answer that is regarded as unique, 
and thinking is to be channeled or controlled in the 
direction of that answer .... In divergent thinking, 
on the other hand, there is much searching about or 
going off in various directions .... Divergent think- 
ing ... characterized as being less goal-bound. 

There is freedom to go off in different directions .... 
Rejecting the old solution and striking out in some 
new direction is necessary, and the resourceful 
organism will more probably succeed (22, pp. 6, 7, 9). 

One of the more comprehensive studies of the personality of 
the creative person was performed by MacKinnon (33). A few find- 
ings derived from the administration of several well-known person- 
ality instruments to a group of creative architects are reviewed 
below: 

1. The Vfelsh. Figure -Preference Test : On this test, the 

creative individuals showed a marked preference for 
complexity and assymetry. MacKinnon reasoned that 
creative persons are challenged by disordered multiplicity 
and have an unusual ability for the richness they are 
willing to experience. 

2. The Myers-Briggs Type Indicator : On the sense percep- 

tion versus intuitive, perception scale, creative 



individuals demonstrated preference for intuition -which 
implies focusing on possibilities, 

3. The Strong Vocational Interest Blank : From this test 

it -was concluded that the creative architects vere dis- 
interested in details, cared more about meanings and 
iii5)lications and -were unwilling to police either their 
own in^pulses and images or those of others. 

The California Psychological Inventory : The profile of 

the creative person suggests that he is dominant, self- 
assured, not socially oriented, uninhibited, free from 
conventional restraints, highly motivated in independent 
activities, autonomous, outspoken and flexible. 

5» Self-Concept Report : The creative architects desired to 

be more sensitive than they were, whereas the noncreative 
architects desired the incompatible attributes of sim- 
ultaneously being more original and more self-disciplined. 

Congruent with this line of thought, Barron (2) in his study 
of the "disposition toward originality", suggests that creative 
individuals prefer complexity and some degree of apparent imbalance 
in phenomena. Barron reasons that ^creative persons are disinclined 
to discipline their thoughts and actions and that through past con- 
ditioning, they have come to seek the more complex and disorganized 
problems in life. Anderson (l), in accord with MacKinnon’s (33) 
results, obtained evidence suggesting that impulsivity is a char- 
acteristic of creative children in a study involving 320 seventh 
graders. 

To the extent that available tests of creati-vity measure not 
only creative abilities, but also measure a general disposition 
toward creativity, then it might be expected that the creative in- 
dividual would find the structure of -the programed learning task in- 
coi^ruent with his needs and preferences. The restrictiveness, 
repetitiveness and extensive organization of the programed learning 
task would appear to conflict with such hypothesized characteristics 
of the creative person as his impulsiveness, his need for autonomy, 
and his heeds for assymmetry and complexity. 

Gotkin and Massa (20) performed an experimental study which 
provides some empirical support for this rationale. Eighteen gifted 
fourth graders and 25 gifted fifth graders cpn^leted a lesson a day 
fer a two-month period in Markle’s (3$) Words program. Four 
achievement tests (two pre- and two jpost-) were given to all Ss, 
and a measure of creative thinking ability was administered prior to 
beginning the instruction. When all Ss were considered as a group, 
a significant negative correlation (r = -.34, p < .05) was obtained 
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between creativity scores and scores on the first achievement post- 
test. The comparable correlation for the second achievement posttest 
was -.29. 

The results reported by Gotkin and Massa (20) provide one piece . 
of evidence for the tenability of the rationale presented above. 
Further investigations with different types of programed materials 
and a more representative sample of creative individuals is needed 
to determine if the negative correlation between creativity and 
achievement is a function of programed materials in general (i.e., 
the structure of programed materials), or of other factors.. 

One might also reason that sufficient reinforcement for making 
the appropriate response required by the structure of the program 
would have the effect of increasing the ^’s preference for conver- 
gent modes of responding. Consequently, one effect of er^erience 
with programed instructional materials may be a temporary reduction 
of the S’s creative or divergent thinking abilities. 

The second personality characteristic which appeared to the 
investigators to be of relevance for achievement with programed 
instructional materials is anxiety . A large body of research in- 
dicates that anxiety is negatively relted to school achievement 
(42), especially achievement in areas involving verbal or reading 
skills (26). Sarason et al. (45) present empirical evidence for a 
theory of school anxiety in which the school anxious child is char- 
acterized as excessively dependent upon external support in the learn- 
ing situation, and is easily disconcerted by evaluative and other 
adverse comments made by his teacher. They believe that the typical 
interpersonal relationship between the teacher and the elementary 
school student contains these and other elements which have the 
effect of making certain children anxious and insecure, and thus 
reduce the efficiency with which they learn in the classroom. 

The dependency and emotionally reactive characteristics of 
the school anxious child also appear to restrict his ability to 
learn from different types of subject matter presentations. Re- 
search reported by Hill and Sarason (26), Gifford (I8), and Grimes 
and Allinsmith (2l), suggests that an optimal learning environment 
for the’ school-anxious child should be conposed of elements which 
have been termed structure . Some of these elements are: (l) the 
teacher should cater to the child’s need for explicitness in the 
requirements of the learning task; (2) information should be pre- 
sented gradually and in an organized fashion with clear-cut rules 
for handling the information; (3) sufficient practice should be 
given the child at initial levels of the learning task so that 
adequate performance at higher levels is assured; and (4) feed- 
back should be relatively continuous and positively reinforcing at 
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all task levels to indicate to the child that he is progressing 
successfully in learning the task. 

This analysis is supported from a basic theory of learning and 
drive level (9> 27). Essentially the theory states that there is 
an optimum level of drive for each learning task. The efficiency 
of learning a task is an inverted "U" function of drive level 
(anxiety) and the difficulty of the task. Individuals who score 
high on anxiety questionnaires are more reactive to drive inducing 
stimuli such as the difficulty level of the task. Thus, under cer- 
tain conditions, they will perform less efficiently than individuals 
who. score low on anxiety questionnaires. 

From this analysis, it appears that programed instructional 
materials may offer an ideal structure for the optimal learning 
of the school-anxious individual. For one thing, the frequency 
of adverse cues (negative reinforcers), potentially involved in 
the social-emotional relationship between the anxious student and 
his teacher, are substantially reduced through the privacy of the 
programed learning situation. More important, however, is the 
potential which the typical programed learning sequence appears to 
hold for meeting the learning needs of the anxious student. 

Objectives of the Research 

The primary objectives of this research are to evaluate the 
relative importance of the contributions of selected characteris- 
tics of learners to success in learning from a representative pro- 
gram of the linear, constructed-response type. Based on the previous 
rationale the following research questions are raised; 

1 . - 

1. To what extent do the creative thinking abilities of 
Ss contribute to their success in learning from pro- 
' gramed instructional materials? 

The rationale suggests that the creative thinking abilities of 
> Ss will contribute negatively to their achievement from programed 

instructional materials. It is also possible that experience with 
programed instruction may habituate the S to more rigid and conver- 
gent modes of thinking due to the continuous practice and reinforce- 
ment in this type of thinking provided by the program. This would 
suggest that eventually some type of interference with divergent or 
creative modes of thinking would accrue, with the possible outcome 
of a temporary reduction in the S*s creative verbal expression. 

^ 2. To what extent do the anxiety levels of Ss contribute 

to their success in learning from programed instructional 
materials? 

7 




At the elementary school level, test anxiety correlates nega- 
tively with performance on achievement tests involving both verbal 
and mathematical skills. The value of the correlation with verbal 
or reading achievement approaches -.50 at the upper elementary grade 
levels (26). The previous rationale suggests that with programed 
instructional materials, anxiety may make a positive contribution 
to achievement. 



3. To what extent do the intelligence levels of ^s contri- 
bute to their success in learning from programed instruc- 
tional materials? 



The typical program attempts to provide for individual differ- 
ences in abiiity through rate of response. It has been implied that 
this provision for individual rates of responding will result in 
achievement levels which will not differ greatly for Ss of differ- 
ent ability levels ( 3 l)« Cattell and Sealy (7) estimate that 
approximately one -quarter of the variance of school achievement is 
attributable to general intelligence. It is of some importance to 
determine the contribution of intelligence to achievement from 
programed materials when the Ss are free to complete the program at 
their own individual rates in the normal classroom situation. It 
may be e:q)ected that intelligence would contribute positively to 
achievement with programed instructional materials. 




In addition to the questions stated above, the design and 
analysis of the research made it possible to secure evidence re- 
garding such questions as: 

4 . What is the extent of the contribution of the inter- 
action of anxiety and the creative thinking abilities 
of Ss to their success in learning from programed in- 
structional materials? 

5. ^^hat is the extent of the contribution of the inter- 
action of anxiety and the intelligence levels of Ss 

to their success in learning from programed instructional 
materials? 



6 . \^at is the extent of the contribution of the interaction 
of the intelligence levels and creative thinking abilities 
of Ss to their success in learning from programed instruc- 
tional materials? 



SECTION 2 



METHOD 

2,1; General Design of the Research 

The major focus of the research was upon ascertaining the impor 
tance of sixth graders’ verbal intelljgence, verbal creativity and 
anxiety scores (and their interactions)jas contributors to their 
success in learning from programed instructional materials. A 
san^le of sixth graders was administered tests designed to measure 
these characteristics. These sixth graders then participated in a 
two-week classroom experience with programed instruction. The 
program selected for the research was entitled Latitude and Longi- 
tu^. A measure of the level of learning of the concepts and 
factual material taught in the program was administered to each 
£ prior to and upon conviction of the program. The dependent var- 
iable was the ^s’ acLievement at the end of the instructional con- 
dition as measured by a specially constiucted criterion test. 
Multiple regression analysis was used to evaluate the relative im- 
portance of each of the learner characteristics and their inter- 
actions as contributors to sixth graders’ success in learning from 
programed instructional materials. 

In addition, this research investigated the possibility that 
exposure to programed instruction might have the effect of reducing 
the creative performance of ^s. Four of the classes which received 
programed instruction were ccmpared with a control group of four 
classes vdiich did not receive programed instruction. The dependent 
variables were the meein residual-gain scores for each class on the 
verbal creativity battery. The programed and nonprogramed groups 
were formed on the basis of random assignment of classes. Each 
group was given the verbal creativity battery shortly before and 
after the programed instructional treatment. 

T**j preparations for the experimental phase of the research 

phase . During this phase of the research a "dry 
run was accomplished, using all of the materials and instruments 
which were later employed in the experimental phase of the research. 
The major objective of the pilot phase was to construct a criterion 
test to measure learning from the programed materials. 

Part of the research effort was concerned with the validity 
and reliability of the anxiety score. This effort is reported in 
some detail in Section 2,4, since it presents some new data rele- 
vant to the use of questionnaire measures of anxiety in school 
situations. 



In smmnary, the research involved four separate, but inter- 
related efforts. Each of these efforts will be reported separately 
in subsequent parts of this report. In the following section the 
characteristics of the sample which provided the source of data for 
all of the research efforts (with the exception of the pilot study) 
will be described. 



2.2: Selection of Subjects 

In choosing the sample of classes for the experimental phase of 
the rese.arch, it was necessary to select on the basis of several 
criteria. In general these were practical criteria, such as in- 
suring, that the bulk of the subjects had the reading level considered 
to be necessary for comprehending the material in the Latitude and 
Longitude program (25). To some extent, the use of the selection 
criteria resulted in a sample which may be characterized as non- 
representative of sixth grade classes in general. However, for the 
most part the biases which may have been introduced by use of the 
selection criteria in this research do not seem to be overly serious 
with regard to generalization of results. In the following account, 
the procedures used in selecting the sample are described in detail. 
The reader will thus have an opportunity to Judge for himself the 
possible biases which may have been introduced. 

School officials in Hornell, Corning, and Painted Post, New 
York, agreed to participate in the research. The latter two cities 
support a combined school system. The i960 census figures (24) 
estimate the population of Corning at 17,085, of Hornell 13j907j 
and of Painted Post 2,570. The three cities are rural-industrial 
centers in the West-rcentral part of New York State. School officials 
in both systems provided information regarding grouping patterns 
in their schools, recent intelligence and/or reading test scores, 
and class lists indicating the number of pupils of each sex. 

From the data provided by the school officials, an initial 
group of 19 sixth-grade classes was identified in the two pairticipat- 
ing school systems. The following criteria were then applied in 
further reducing the sample to meet the requirements of the research: 
(1) each class should contain a proportionately small number of Ss 
with reading problems (a reading problem is defined as a standardized 
grade equivalent reading score of less than 5»0); (2) the propor- 
tion of the sexes in each class and for the total sample should be 
equivalent 5 (3) each class should represent as far as is possible, 
a normal range of abilities; (4) the classes selected should be 
relatively homogeneous with respect to program of study and 
previous experience with programed instruction; and (5) teachers of 
the classes in the sample should not have begun systematic instruc- 
tion in the subject matter of the program prior to the initiation 
of the research. 
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Four of the 19 classes comprising the preselection sample were 
rejected because of either low reading scores or a narrow range of 
IQ scores. Of the remaining 15 classes, it was determined that • 
none had had previous experience with programed instructional 
materials. Discussions with school administrators indicated that 
' the sixth-grade curricula in the various schools in both systems 
were quite similar (criterion number four). Criterion number five 
was also met by all classes. 

The Lorge -Thorndike IQ Test, Level III, Verbal Form-A (30), 
was administered to the Ss in the sample of 15 classes by project 
staff members. The intelligence and sex distributions and reading 
scores of each of the classes were examined. Two classes were then 
eliminated because of extreme homogeneity of IQ scores. The remai,n- 
ing 13 classes were then randomly assigned to conditions, with four 
classes assigned to the control condition (no programed instruction), 
and nine to the experimental condition (programed instruction). 

Table I presents the number of Ss in each e:qperimental class 
with standardized grade -equivalent reading scores below 5*0. From 
initial tryouts of the Latitude and Longitude program (25) in teach- 
ing sixth graders, the writers concluded that a grade equivalent 
reading level of 5*0 was a minimum requirement for satisfactory 
performance on the program. It can be seen that this requirement 
has been met for all practical purposes in all but one of the 
classes. In class number 121, approximately l6 percent of the Ss 
were reading at a level below the acceptable minimum. This dis- 
crepancy, hovrever, was not considered serious enough to reject the 
class for use in the research. 

Table II shows the sex distributions of the pupils in the 
programed and control conditions, and the number of pupils lost in 
the final sample during the data collection period. These des- 
criptive data are presented by class, as well as for the total pro- 
gramed and control groups. From these figures, it will be noted 
that 62 pupils were lost from the final sample during the data 
collection period. The losses constituted approximately 20 percent 
of the available total for each group. From the figures on sex, 
it is evident that the proportional representation of the sexes is 
lopsided in some of the classes (notably classes numbered 8ll, 9Hj 
132, and 712). However, the proportional representation of the 
sexes in each condition (roughly 50 percent in each) was maintained, 
despite losses. Losses were almost entirely due to absences on 
test days. 

Table III presents mear; IQ scores with standard deviations and 
ranges for the final sample of 13 classes. It will be noted that 
the mean IQ score for the experimental group is 5*12 points higher 
than the mean for the control group. This difference, however. 
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Table I 



Numbers of Pupils With Reading Limitations 
in the Programed Condition Classes 









Hornell, New York 
Class Number 


Total N Reported 


N Below 5*0 


111 


24 


2 


121 


24 


4 


311 


23 


1 


4ll 


28 


1 


511 


24 


2 


Corning -Painted Post, New York 






Class Number 


Total N Reported 


N Below 5«0 


721 


22 


1 


811 


23 


O' 


821 


23 


0 


911 


21 


0 
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Table II 



Sex Distribution of Pupils in the Programed and Control Conditions 
and Pupils Lost in the Final Sample 
During the Data Collection Period 



Programed Condition 



Totals 



Complete Data* Pupils Lost for Classes 



Class Number 


Boys Girls Total 


Boys Girls 


Total 


Boys Girls 


Total 


111 


11 


8 


19 


2 


3 


5 


13 


11 


24 


121 


10 


11 


21 


3 


0 


3 


13 


11 


24 


311 


10 


8 


18 


3 


0 


3 


13 


8 


21 


4ll 


l4 


11 


25 


3 


1 


4 


17 


12 


29 


511 


10 


10 


20 


3 


1 


4 


13 


11 


24 


721 


10 


9 


19 


2 


1 


3 


12 


10 


22 


8ll 


4 


11 


■ 15 


4 


3 


7 


8 


l4 


22 


821 


6 


8 


14 


4 


5 


9 


10 


13 


23 


911 


5 


9 


14 


2 


4 


6 


7 




20 


Total 


80 


85 


165 


26 


18 


44 


106 


103 


209 






Control Condition 










• 
















Totals 






Complete Data* 


Pupils Lost 


for Classes 


Class Number 


Boys Girls 


Total 


Boys GTrls Total 


Boys 'Girls Total 


132 


8 


15 


23 


2 


0 


2 


10 


15 


25 


212 


13 


9 


22- 


1 


3 


4 


14 


12 


26 


612 


8 


8 


16 


■3. 


2 


5 


11 


10 


21 


732 


11 


5 


16 


4 


3 


7 




8 


23 


Total 


40 


37 


77 


10 


8 


18 


50 


45 


95 








Total Sample 














• 










Totai-‘ for 






Complete ! 


Data ■ 


Pupils Lost 


Combined .Classes 




Boys Girls 


Total 


Boys Girls Total 


Boys Girls 


Total 


13 Classes 


120 


122 


242 


36 


26 


62 


156 


l48 


304 ’ 



*Final sample upon which data are based. 



is irrelevant to the major focus of the research which is concerned 
only with analyses for the experimental group. 



Table III 

IQ Means i Standard Deviations and Ranges of the Classes Selected 

to Participate in the Research 



Programed Condition 



Class Number 


N 


X IQ 




Range 


111 


24 


110.55 


17.0 


78-rl40 


121 


24 


105.75 


12.9 


79-133 


311 


21 


108.90 


13.6 


89.138 


4ll 


29 


115.10 


12.6 


91-140 


511 


24 


108.30 


11.5 


90-i40 


721 


22 


110.60 


14.6 


88-147 


811 


22 


102.45 


14.6 


91-i4o 


821 


23 


109.60 


12.2 


84-134 


911 


20 


110.25 


11.2 


91-129 


Total "Programed"'^ 


209 


109.34 


13.63 


78-147 


Total Less All Lost 


Ss** 165 


110.72 


13.39 


78-147 


• 


Control 


Condition 






Class Number 


N 


X IQ 




Range 


132 


25 


103.00 


12.4 


77-124 


212 


26 


108.05 


12.5 


94-143 


612 


21 


106.00 


16.3 


81-131 


712 


23 


106.05 


14.5 


84-138 


Total "Control"* 


95 


105.73 


• 13.75 


■ 77-143 


Total Less All Lost 


Ss** 77 


105.60 


13.97 


77-143 



■^Represents data collected from classes without lost subjects. 
■^Data collected only from the sample for which complete sets 
--of scores on all instruments were available. 



In summary, the final sample to be used in the research con- 
sisted of two groups: (l) an experimental group composed of a total 
of 165 Ss from nine classrooms in two separate school systemsj and 
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(2) a control group composed of 77 Ss from four classrooms in the 
same two srnool systems. With classes combined, both groups had 
nearly equal numbers of the sexes. It was concluded that within 
the experimental group, only a small fraction of the did not have 
the reading capability to enable them to achieve satisfactorily from 
the program used in the research. 

2.3: The Pilot Phase of the Research: 

Development of the Criterion Test 

The major purpose of the pilot phase of the research was to 
construct a- criterion test to be used for measuring the amount of 
achievement from the programed instructional sequence. Other 
objectives included: (l) trying out the Latitude and Longitude 
program (25) and refining a preli m inary set of instructions for 
teacher use of the program; (2) administering the learner charac- 
teristics measures to ascertain the appropriateness of the admin- 
istration procedures (e.g., timing, instructions, etc.); and (3) 
training project staff in the methods of administration of the 
learner characteristics measures, and in general familiarizing the 
staff with all procedures necessary for administration of the re- 
search during the experimental phase. 

The purpose of this section is to describe the development of 
the criterion test. The accomplishment of the other three objec- 
tives was helpful in refining the procedures used in the experi- 
mental phase of the research. 

The development of the criterion test was pursued in three 
stages. The first stage consisted of the preparation of 90 objec- 
tive test items which formed the basis for the construction of two 
preliminary test forms. In the second stage, the program and 
learner characteristics measures were administered iii the schools 
under conditions closely approximating those used in the experi- 
mental phase of the research. The final stage involved the admin- 
istration of the two preliminary forms of the criterion test, and 
the construction of the final criterion test based on the results 
of this administration. 

Stage One 

Eighty-eight multiple choice items, with four choices for each 
question, were constructed to measure the objectives of the program. 
These items were either written by project staff or were taken from 
a test provided by Coronet Instructional Films Incorporated (8). 

Two additional questions were developed which required a brief ^ 
written response (recording the latitude and longitude of a point 
indicated on a small map). 
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These items "were constructed so that there "would be equal 
numbers of items for evaluating each of the major objectives of 
the programed instructional sequence. Correct responses were 
evenly divided among the four choices of the multiple choice items. 
The 90 items constituted the original item pool. These items were 
then divided equally into two tests. Forms A and B. !Hie major 
objectives of the program were evaluated by equal numbers of items 
in each form of the test. 

Stage Two 

Four sixth-grade classes in two public school systems (Savona, 
New York, and Campbell, New York) participated in the pilot phase 
of the research. The results to be reported are based on data 
obtained from a total of 84 ^s of both sexes, with each school 
system contributing 42 Ss to the total. None of the Ss had had 
previous instruction with programed materials. 

The pilot phase of the research was initiated in the early 
part of October, 1965, and completed approximately two weeks later. 
With the exception of the preliminary forms of the criterion test, 
the learning materials and instruments used in the pilot study were 
the same as those used in the experimental phase of the research.! 
The Ss in both pilot schools received ten units of instruction using 
the program. Latitude and Longitude (25). 

The preliminary forms of the criterion test were administered 
by project staff on the day following the last unit of the pro- 
gramed sequence. Equal numbers of both forms were distributed 
randomly to the ^s in each of the pilot classes. A 40 minute period 
was allowed for actual working time on the test forms. This proved 
to be ample time for each ^ to finish. Table IV summarizes the 
order of administration of the learner chairacteristics measures, 
the preliminary forms of the criterion test and the programed 
instructional sequence in the classes in both pilot schools. 

On the day prior to the initiation of the first unit of the 
programed instinctional sequence, the teachers explained to their 
classes the procedures involved in lesirning from programed materials 
and instructed them in the mechanics of using the sliding cover 
attached to the program. The teachers en5)hasized that the Ss 
would be tested upon completion of the program and that the re- 
sults of the testing would constitute a normal part of classroom 
evaluation. The teachers were requested not to help the S with the 



^Details on the instruments used in .the pilot phase of the re- 
search are given in Section 2. 4, 
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Table IV 



Schedule of Administration of Learner Characteristics Measures , 

The PrelirnTnary Criterion Tests 
and the Programed Instyuctional Sequence in the Pilot Schools 





School Days 


Caim)bell, N.Y. 


Time 

(Min.) 


Savona, N.Y. 


Time 

(Min.) 


Day 1 


Verbal 

Creativity 

Battery 


25 


Lorge- 
Thorndike 
IQ Test 


45 




Anxiety 

Test 


25 


Anxiety 

Test 


25 


Days 2-12 


Ten Periods of 


Programed Instruction* 


30 

Per Period 
(Approx. ) 


Day 13 


Anxiety 

Test 


25 


Anxiety 

Test 


25 




Criterion 

Test 

(Forms A & B) 


ko 


Criterion 

Test 

(Forms A & B) 40 

■ '■ — ^ j: 



*A school holiday interrupted the sequence of the instruction. 



program or provide supplementary instruction in the subject matter 
of the program. An additional request was that the teacher con- 
tinually observe that the Ss kept the confirming responses in the 
program concealed until they had recorded their own responses. 

Each S was provided with a copy of the 19^3 revision of the 
Latitude and Longitude program (25) j and a 10-page mimeographed 
response booklet which the S was to use for recording his responses. 

response sheets and programs were collected each day when in- 
struction’ was Completed. On each of ten school days, the So 
coa^)leted a scheduled unit contained in the program. Additional 
time beyond the half hour scheduled for the program was available 
to the S if necessary. 



stage Three 



Item analysi.s procedures were used to determine the difficulty- 
levels and discrimination indexes for the items in each form of the 
test. The discrimination index for each item was obtained as . 
follows. Using total score on the form as an internal criterion, 
the proportion of ^s in the lower 27 percent of the distribution 
passing any given item was subtracted from the proportion of Ss 
in the upper 27 percent of the distribution passing the item. The 
difficulty level for eui item was the percentage of the total number 
of Ss who answered the item correctly on a given form. 

The final criterion test was then constructed by selecting 
the "best" 50 items from Forms A and B. The criteria employed for 
selection of items were: (l) each of the major topics of the pro- 
gramed instructional sequence should be evaluated by equal numbers 
of items in the final test; and (2) insofar as was possible, the 
items selected for the final test should have difficulty levels 
within the 40 to 6o percent range and discrimination indexes of 
40 percent or greater. 

A comparison of the distributions of item discrimination 
indexes and difficulty levels for the retained and rejected items 
is shown in Table V. The reader will note that generally items with 
very high or very low difficulty levels and items with low dis- 
crimination indexes were rejected from the original item pool. 

Three items with less than acceptable difficulty levels and dis- 
crimination indexes were retained in order to maintain proportional 
representation of each of the objectives of the programed instructional 
sequence. These items were revised before inclusion in the final 
form of the test in the hope that their discrimination power would 
be improved. 

The 50 items selected for inclusion in the final form of the 
criterion test are listed in Table VI. The item number in the 
final form, and the discrimination index and difficulty level for 
each item are indicated. The mean discrimination index for the 50 
items was 49.28 percent, with a range of zero to 83 percent. Sixty 
percent of the items had discrimination indexes of 50 percent or 
more; 24 percent of the items were in the range of 30 to 49 percent, 
and eight percent of the items had discrimination indexes of less 
than 30 percent. The mean difficulty level was 51.18 percent, with 
a range of difficulty levels of four to 7I percent. Fifty-six per- 
cent of the items were in the 40 to 60 percent difficulty range; 30 
percent of the items were in the 6l to 71 percent range; and l4 
percent of the items had difficulty levels of less than 4o per- 
cent . 
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Table V 



Distributions of Difficulty Levels and Discrimination Indexes 



of Items Accepted and Rejected from the Original Ninety-Item Pool 




Difficulty 


Frequency (of items 


Frequency (of 


Level 


accepted for final test) 


rejected items) 


90-100 


0 


5 


80-89 


0 


12 


70-79 


2 


11 


60-69 


. 13 


6 


50-59 


19 


1 


40-49 


9 


1 


30=39 


2 


1 


20-29 


3 


1 


10-19 


1 


2 


0-9 


JL 


-2. 


Total 


50 


40 


Discrimination 


Frequency (of items 


Frequency (of 


Index 


accepted for final test) 


rejected items) 


90-100 


0 


0 


80-89 


2 


0 


70-79 


6 


0 


60-69 


5 


2 


50-59 


17 


4 


40-49 


6 


9 


30-39 


6 


6 


20-29 


5 


4 


10-19 


2 


9 


0-9 


1 


5 


Negative 


_0 




Total 


50 


4 o 



The final criterion test consisted of 48 four-choice objective 
questions and two "fill-in-the -blank" questions. The three items 
with an asterisk in Table VI were changed before use in the final 
test. The "foils" and questions in these items were .altered to 
make them less ambiguous. 
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